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1 Introduction. 

In this paper, we investigate a continuous time two-player zerosum game with lack of informa- 
tion on one side: according to a given probability, some payoff is chosen randomly among a 
family of payoffs depending on a parameter taking its values in R^, and is communicated to 
one player (say Player 1), Player 2 being only aware of the underlying probability. Then Player 
1 want to minimize, Player 2 to maximize the payoff. 

Games with incomplete informations (where some players have private informations) were intro- 
duced in the framework of repeated games by Aumann and Maschler in the nineteen sixties (see 
PQ) and are, since then, the aim of many works, see for instance [7], |12j . |14| and the references 
therein. 

The first author of the present paper introduced the continuous time case in [3j. It is proven 
there that, under suitable assumptions, differential games with asymmetric informations have 
a value which can be characterized as a solution in some dual, viscosity sense of a Hamilton- 
Jacobi-Isaacs equation. The result was generalized to stochastic differential games in [3]. 
A crucial point in games with incomplete information is that, the players observing each other 
all along the game, the non informed player will try to guess his missing information through 
the actions of his opponent. This implies that the informed player, instead of fully using his 
information, needs to reveal it sparingly and to hide its revelation by using random strategies 



to this aim. In the framework of repeated games, the behavior of the informed player is there- 
fore strongly linked with a martingale with values in the set of probability measures, called 
"martingale of beliefs" , which describes the belief the non informed player has on the chosen 
index. Rewriting the value of the game as an optimization problem over the set of martingales 
has been extensively used in the recent literature [H [9]. When the set of possible payoffs is 
finite (say: I possible payoffs), this set of probabilities over {1, . . . , 1} can be assimilated to the 
simplex A(/), subset of R . In the case of continuous times games without dynamic, and in 
analogy to the repeated games, we proved in [5], that the value function of the game is solution 
of an optimization problem over this set of R^-valued martingales. This result is generalized to 
stochastic differential games by Griin |10j . 

In the present paper we investigate the case of continuous games without dynamics, with a 
continuum of possible cost functions. A crucial aspect of games with a finite number of possible 
payoffs, is that the set of probability-measures can be assimilated to M. 1 . Therefore the value 
function depend on two parameters t G [0, T], the starting time and p € A(I) the initial proba- 
bility and, even if the place taken by the parameter p in the Hamilton-Jacobi-Isaacs equation is 
not standard, it is still an equation in 1 x I 7 . The equivalent formulation of the value function 
as a control problem over a set of martingales In the case of a continuum of possible payoffs. 

The main results of this paper are, on the one hand, a representation formula of the value 
in terms of a minimization problem over a set of martingale measures and the existence of an 
optimal martingale measure. On another hand, we also characterize the value as the (dual) 
solution of a Hamilton-Jacobi equation. 

2 Notations and preliminaries. 

Let us first introduce the model we will study throughout the paper. We consider a continuous 
time game starting at some initial time to > and ending at a terminal time T > to- The 
players try to optimize an integral payoff of the form 




£(x, s, u(s),v(s)) ds 



where (u{s)) s ^\t 0l T\ is the control played by the first player while (v(s)) se u 0tT ) is the control 
played by the second player. The first player is minimizing, the second one maximizing. The 
main point in the above payoff function is its dependence with respect to a parameter x. The 
game is played as follows: at time to the parameter x is chosen by nature according to some 
probability fh and the result is announced to the Player 1, but not to the Player 2. Then the 
players choose their respective controls in order to optimize the payoff. The map i as well as 
the measure fh are public knowledge. 

To fix the ideas, we will assume throughout the paper that the parameter x belongs to some 
Euclidean space WL N . Although this assumption is not really important for the existence of a 
value, the representation Theorem 13.21 or the characterization of the value given in Proposition 
14. H it will be crucial for the existence of an optimal martingale measure (Theorem I3.3P or a 
sharper characterization (Proposition 14. 3| ). 

Moreover, to get some compactness ensuring the existence of an optimal martingale measure, 
we will have to assume that the measure fh has some finite moment. Again, to fix the ideas, we 
will assume the finiteness of the second moment (however, the reader will easily notice that any 
moment larger than 1 would do the job). Let A(R Ar ) be the set of Borel probability measures 
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on R and II2 be the subset of A(M ) with a finite second order moment: 

/ \x\ 2 dm(x) < +00 Vm G II2 . 



It will be convenient to endow II2 with the Monge-Kantorovich distance di: 



di(m, m!) 



761I(m,m') J^2N 



inf / 



x - y\dj(x,y) 



where U(m, m!) is the set of Borel probability measures on R 2N such that j(A x R N ) = m{A) 
and 7(IR iV x A) = m'(A) for any Borel set A C R N . Recall that the above minimization problem 
has at least one minimum and we denote by Ii op t (m,m/) the set of such minima for di. Again 
there is some arbitrariness in the choice of this distance, but it is useful here to fix the notations. 

Let T > be a finite time horizon, and U and V two compact subsets of some finite 
dimensional space. For all < to < h < T we denote by U(to,ti) = {u : {to, t\] — >■ U measurable} 
the set of controls with values in U. We endow U(to,ti) with the L 1 distance 



and with the Borel a— algebra associated with this distance. Recall that U(to, ti) is then a Polish 
space (i.e., a complete separable metric space). The set V(to,t±) of Lebesgue measurable maps 
v : [to,ti] — > V is defined in a symmetric way and endowed with the L 1 distance and with the 
associate Borel a— algebra. We write U(to) and V(io) for U(to,T) and V(to,T). 
The instantaneous reward 



is assumed to be continuous in all variables, Lipschitz in (x, t) uniformly in u and v, and bounded. 
Fix now (to,m) G [0, T] x n 2 . For all (u,v) G U{to) x V(*o), we define the payoff 



Note that J(to,m,u,v) is the mean with respect to the probability m of a family of running 
costs depending on the parameter x G M. N . The control u represents the action of Player 1, v 
the action of Player 2. In this game, Player 1 will try to minimize, Player 2 to maximize the 
payoff. 

In order to give a probabilistic interpretation of the game, we now introduce a probability space 
(CIq, Tq, Pq). If X is a random variable of distribution m, we can rewrite the payoff 



The next step is to define the strategies of the Players. We have to model the facts that 

• Player 1 knows the index x before the game starts, but not Player 2, 

• each Player observe the action of his opponent, 

• the Players can act randomly. 





£ : R N x [0, T] x U x V -)■ R 
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The strategies of Player 1 are defined as follows: For some fixed subdivision A : to < t± < 
. . . < t n = T, let ^4a(*o) be the set of Borel measurable maps a : V(to) — > U(to) which 
are nonanticipative with delay with respect to the subdivision A : for any v\,v 2 G V(to), if 
V\ = V2 a.e. on [to,U] for some i G {0, ...,n — 1}, then a(v\) = a(v 2 ) on [to, ^i+i] • We set 
A(to) = Ua-4.a(*o) an d endow A(to) with the distance 

d(a 1 ,a 2 ) = sup d u ^ )(ai(v), a 2 (v)) 
vev(t ) 

An element of B(to), the set of strategies for Player 2, is a nonanticipative, Borel measurable 
map f3 : U(to) — > V(to) such that, for all t G [£q,T], for any Ui,u 2 G U(to), there exists 5 > 
such that, if u% = 112 a.e. on [to,t], then (3(ui) = P(u 2 ) on [to,t + 6]. (i.e, in contrast to the 
strategies of Player I, Player II is allowed to adapt his delay belonging what he is answering to). 

Due to the delays the Players have to respect, we get, as in [HE]: 

Lemma 2.1 There exists a Borel measurable map $ : A(to) x B(to) — > U(to) x V(to) such that, 
for all pair (a, f3) G A(t ) x B(t ) and (u,v) G U(to) x V(t ), 

(u,v) := $(a,/3) [ a(u) = u and /3(u) = v a.e. ] (2.1) 

Definition 2.2 Fix some o£/ier sufficiently large probability spaces (£li,J-i, Pi) and (£l 2 ,J~2, -F2). 
A strategy for Player I for the initial time to G [0, T] is a measurable application a from M. N x Qi 
to some .4a (*())• We denote by Ax (to) the set of these strategies. 

A strategy for Player II is a random variable on (O2, P2, P2) with values in B(to). We denote 
by B(to) the set of strategies for Player II. 

We set (Q, T,P) = (fi x^x 2 ,Po ® ?\ ® ^2,Po ® p l ® -P2) and denote by #[•] the corre- 
sponding expectation. 

Fix to G [0, T]. For any (a, (3) G Ax(to) x B(to), we are now able to define the payoff of the two 
strategies by 

J(t ,a,f3,m) := [ [ £(x, t, $(a(x, wi), /3(u 2 ))(t))dt dPi(uJi)dP 2 (uJ2)dm(x) 

JR N xA(to)xB(t ) J t 



E 



T 

£(X,t,<$>(a(X),p)(t))dt 

to 



The upper and lower value functions of the game are defined by 

V + (to,m)= inf sup J(t®, a, j3, m), 

at Ax (to) peB(t ) 

and 

~V~(to,m)= sup inf J (to, a, j3, m). 



Note that we also have 



Y + (to,m) = inf sup J(to,a,f3,m). 
a£A x (t ) peB(to) 

Lemma 2.3 The value functions V + and V~ are Lipschitz continuous. 
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Proof: We only explain the proof for V + , the arguments for V~ being symmetrical. Let us first 
check the Lipschitz continuity in m. Let mi,rri2 G 1T2 and 7 G n op t(mi, 012). Let us desintegrate 
7 with respect to mi: d r y(x,y) = d^ x (y)dm\(x) . 
For e > 0, let a 2 € -4v(io) be e-optimal for V + (to,m 2 ): 

sup J(t ,a 2 ,(3, m 2 ) < V + (r ,m 2 ) + e. 

/3eB(t ) 



Let ^ : 1^ x Hi ^ 1^ be a measurable map such that, for all x G M^, the random variables 
(£(x, -),x G 1^) are independent of (a 2 (x),x G K ) and the distribution of each £(x, •) is j x . 
Then the map (u,x,v) — > ai(u;, x, i>) := «2(w, £(x, w), v ) defines a strategy, i.e., an element of 
A x (to). We have, for all /3 G B(i ), 

rT 



,7(to,ai,^,mi) 



Si 



to 



dmAx 



dmiix) I d'j x (y)E 1 



e(x,t,$(a 2 (y),P)(t))dt 



to 



dj(x,y)Ei 



£(x,t,<S>(a 2 (y),(3)(t))dt 



to 



< 



dj(x, y)Ei 



(e(y,tM<X2(v),m))+C\x-y\)dt 



to 



< J(t ,a 2 , /3,m 2 ) + Cdi(mi,m 2 ) 

< V + (t ,m 2 ) + e + Cdi(mi,m 2 ). 



Therefore 



V + (t ,mi) < sup J(t ,ai, (3,mi) <V + (t ,m 2 ) + e + Cdi(mi,m 2 ). 
This proves the Lipschitz continuity of V + with respect to m, uniformly in t. 

Next we prove the Lipschitz continuity in time. Fix m £ Tl 2 , < to < t\ <T and «£[f. 
For e > 0, let a\ be e-optimal for V + (ii,m). We define a strategy in Ax{to) by setting 



a (x,v,ui)(t) 



u for t G [to, ti) 

ai(x, «|| t T] ,wi) otherwise. 

For all /3q G B(to), we define /?i G <S(ii) by setting = /3o(("U,u)), where («, u) denotes the 

control equal to u on [to,t±) and to u on (t%,T). Let (ui(x,u;i), vi(x,u;i)) = <3?(ai(x, Wi), 
be the solution of the fixed point equation given in Lemma 12.11 Then, by definition of ao 
and because /3o is nonanticipative, &(ao(x, uji), /3o) is equal to (u,(3q(u)) on [to, ^i] and to 
(«i(x, wi), vi(x, uji)) on [ti,T]. Hence, as the payoff is bounded by C, 



J(t ,m,a ,(3o) 



E 



f£e(x,tM<xo(x),Po)(t))dt 



< C(h-t Q ) + J(ti,m,ai,/3i) 

< C(ti-i ) + V+(ti,m) + e. 
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Therefore 



The reverse inequality 



V + (t ,m)<C(t 1 -t ) + V+(t 1 ,m) . 



V+(t , m) > V + (ti, m) - C(ti - t ) 
can be established in a symmetrical way. □ 

Lemma 2.4 The value functions and V~ and V + are convex with respect to m. 
Proof: The convexity of V~ is an easy consequence of the definition, because 

V~(t ,m) = sup / inf / / £(x,t,®(a, (3(u)2)))dt dP 2 (u)2)dm(x) , 
PeB(to) J RN aeA( - tQ *> Jo 

which is clearly convex with respect to m. 

Let us now check the convexity of V + . Fix i £ [0>^1 an d let mi,m 2 G n 2 and A G (0, 1). 
Set m = Ami + (1 — A)m 2 . 

Since mi is absolutely continuous with respect to m, there exist j>a £ L 1 (R Ar , M + ; m) such that 

Xm\(dx) = p\(x)m(dx) 

with pa > m— a.e. Remark that 

(1 — A)m 2 (dx) = (1 — p^(x))m(<£a;), 

and therefore that p\ takes its values in [0, 1] m—a.e. Now, for e > 0, let ol\ (resp. a 2 ) G Ax(to) 
be e-optimal for V + (io, mi) (resp. V + (io, m 2 )), and let a G Ax (to) be such that, for all x G M. N , 
and all measurable, bounded / : A(to) — > R, 

Si [/(«(*))] = p A (a;)£i + (l- Px (x))E l [/(a 2 (x))] . 

For any /3 G fi(io), it follows that 



J(t ,m,a,P)= f eAI £(x,t,<f>(a(x),/3)(t))dt 
Jr n Ut 



dm(x) 



P\{x)Ei 



[ T £(x,t,<S>( ai (x),P)(t))dt 

.J to 

A / E 1 f £(x,t,<S>( ai (x),/3)(t))dt 



+ (l- Px (x))E 1 



dmAx) + (1 
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< AV+(i , mi ) + (1 - A)V+(t ,m 2 ) + e. 
Since this holds true for all j3 G B(to) and for any e > 0, it follows that 

V + (t ,m) < AV+(t ,mi) + (1 - A)V+(t ,m 2 ). 



/ £(x,i,$(a 2 (x),/3)(i))cft 

J to 

A) / Si [/ ^(x,t,$(a 2 (x),/3)(t))dt 



dm(x) 



dm 2 (x) 



□ 
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We now introduce the Hamiltonian of the game : 

\/(t,m) € [0, T] x II2, H(t,m) = inf sup / £(x,t,u,v)dm(x), 

ueu ve y J r n 

and assume throughout the rest of the paper that Isaac's condition: for all t € [0, T] and m € II2, 



inf sup / £(x, t, u, v)dm(x) = sup inf / £(x, t, u, v)dm(x). (2-2) 
ueU v( zy J r n v£ v u ^ u Jr n 

Proposition 2.5 Under Isaac's condition the game has a value: for all (to,m) £ [0,T] x 

II 2 , V+(t ,m) = V-(t ,m). 

Proof: The result has been proved for measures m with finite support and very slight different 
notion of strategies in [5]. A careful examination of the proof shows that the result of [5] also 
hold with the new definition of strategies. Let us explain how the condition on the measure can 
be removed. For an arbitrary measure m € II2, let (m n ) ng N be a sequence of measures with 
finite support, such that di (m n ,m) — > n ->+oo 0. Since, by lemma \2~3[ V + and V~ are Lipschitz 
with respect to m, we have, for all to £ [0, T], and all n £ N, 

\V + (t ,m)-V-{t ,m)\ < |V+(to,m)-V + (to,m n )| + |V-(to,m)-V-(t ,m n )| <2Cd 1 (m,m n ), 

where C is a Lipschitz constant for V + and V~. The right-hand side term being arbitrarily 
small, the result follows. □ 

Let us complete this paragraph with a technical Lemma, which shows that the payoff associated 
to a control without delay may be approximated as close as needed by the same control but 
with delay. 

Lemma 2.6 Let m 6 ILj and e > 0. For all v S V(0), there exists 5(v) > such that, for all 



T , ,T 

£(x, s,u s ,v s )dsdm(x) — / / £(x, s,u s ,v^ s ^s(v)) + dsdm(x) 
r n Jo Jr n Jo 



< e. 



Proof: Let M be an upper bound for \£(x, s, u,v)\. Fix e > and let B € B(R N ) a compact set 
such that m(B) > 1 — e/6MT. Then we have, for all 5 > 0, 



T r rT 



£(x, s,u s ,v s )dsdm(x) — / / £(x,s,u s ,V( s _g\ )dsdm(x) 

R N JO JR N Jo 



< e/3 + 1(6, e) 



with 



1(5, e) := / / \£(x,s,u s ,v s ) - £(x,s,u s ,V( s _s) + )\dsdm(x) 
J B Jo 



Now, since £ is continuous, it is uniformly continuous on the compact set B x [0, T] x U x V. 
Therefore there exists 77 > such that, for all (x,s,u) E B x [0, T] x U and v,v' G V with 
\v — v'\ < 77, \£(x, s, u, v) — £(x, s, u, v')\ < e/3T. 
It follows that, for all 5 > 0, 

1(6, e) < e/3 + 2MX({s € [0, T], \v s - v (s _ s)+ \ > n}). 
< e/3+ ™Jo\v s -v {s _ 5 ) + \ds, 
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where the last relation comes from the inequality of Bienayme-Tchebychev. 
Finally it is well known that, for any v G V(0), 

T 

\v s - v {s _s) + \ds = 0. 
Therefore there exists So > such that, for all S < So, 

T 

\V S ~ V(s-8) + \ds < 67//6M. 

The result follows. □ 




3 An alternative formulation of the value function. 

In this section, we show that the upper value function can be represented in term of a mini- 
mization of a cost over a family of martingale measures. Many results on these processes used 
below can be found in Horowitz or Walsh |15| for instance. 

For any < to < ti < T and m G II2, we introduce the set A4(to, t±, m) of all measure- valued 
processes (-M*)to<*<*i defined on a sufficiently large probability space (O, T, P) which satisfy for 
all measurable, bounded functions / : 1^ — > R, 



(i) t i-> / f(x)dM s (x) is P-a.s. cadlag, 



(ii) there exists a R^-valued random variable X of distribution m such that, for all t G [to, ti], 
P-a.s., 

M t f := [ f(x)dM t (x) = E [f(X)\T t M ] , (3.3) 
where (J 7 i^)te[t ,ti} 1S the right continuous, completed filtration generated by (M t (B),B G 



Remarks 3.1 1) Let M G M{tn,t\)- 

• For all t G [to>*i]> the random variable Mt is P-a.s. a probability measure which satisfies 

E [M t {B)\ = m(B), B G B{R N ). 

• The process (Mt) is a martingale measure: for all measurable, bounded function f , (Mtf)t^[t ,ti) 
is a martingale in the filtration {J~t)te[to,ti)- 

• Let G : [to,t\) x R^ x — > R measurable, bounded and such that, for all x G R^ the 
process a;, -))te[to,*i) is adapted to the filtration (F^ 1 ). Then we get, P-a.s., for all 
t G [toM), 

E[G(t,X)\P t M ]= [ G(t,x)dM t (x). 
Jul* 
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2) Conversely, let (J~t)t&[t ,h) be a right continuous and complete filtration on (Q, J-, P). For all 
t€[t ,ti) and B G B(W n ), set 

M t (B) = P[X e B\T t ]. 

Then (Mt) is a martingale measure, which admits a cadlag modification, i.e. a modification M 
such that, for all measurable and bounded function f , (Mtf) is cadlag. It is then clear that this 
modification belongs to M(to,ti). In the sequel we identify all martingale measures with their 
cadlag modifications. 

We write M(t ,m) for M(t ,T,m). 
Now let 



W(t Q ,m)= inf E 
MeM(t ,m) 



H(s,M s )ds 



to 



(3.4) 



where W6 r6Ccill that H(t, 771) — inf n £i usup veV / l(x,t,u,v)dm(x). 
The main result of this section is the following representation formula: 
Theorem 3.2 For all (t ,m) € [0,T] x U 2 , it holds that 

W(t ,m)=V + (t ,m). (3.5) 
Proof: We shall prove the two inequalities providing (|3.5p . 

1) V+(* ,m) < W(t ,m) 

Fix M G M.(to, m) and let u(t, m) be a measurable selection of Argmin ug [/ sup^y / £(x, t, u, v)dm{x) 

Consider the control process u = (u(t,Mt)) tE u Q T y Remark that u is adapted to the filtration 
(J-" t M ). Since X is a realization of the probability measure m, the joint distribution of (u, X) on 
U(to) x can be desintegrated as follows: 

P[(u,X) € dudx] = P x (du)m(dx), 

for some measurable family of probability measures (P x ,x E R ). 

Let now be a strategy olm for Player I such that, for all x € M. N , for all measurable bounded 
/ : U(t ) -> R and for all v G V(t ), 



ExifiaM&v))] = / f{u)P x {du). 
JU(t Q ) 

Then, for any arbitrary (3 € B(to), strategy for Player II, we got 

r T 

J(t ,m,a M ,/3) 



E 



E 



E 



£(s, x, u(s) , P{u) s )dsP x {du)dm{x) 
£(s,X, u s ,/3(u) s )ds 



U(t ) Jto 
T 



to 



to 



E[i(s,X,u s ,p{u) s )\F^] ds 



£(s, x, u s , /3(u) s )M s (dx)ds 

t JR N 
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sup / £(s,x,u s ,v)M s (dx)ds 
t veV 



It follows that 

J(t 0t m,a M ,P) < E 
Due to the arbitrariness of fi G B(to) and the definition of u, it follows that 

su P/3eB(t ) J(to,rn,a M ,P) < E 



T 



sup / £(s,x,u s ,v)M s (dx)ds 
t veV Jr n 



E 



H(s,M s )ds 



t 



The result follows. 

2) W(t ,m)<V+(t ,m) 

2.0) Fix e > 0. Let a e G Ax(to) be e-optimal for V + (to,m). The assertion follows as soon 
as we find some M G .A4(iQ,m) and /3 G S(£q) such that 



E 



£(X,s,<5>(a e (X),/3)(s))ds 



to 



> E 



H(s,M s )ds 



to 



e. 



More precisely, we shall prove by induction, that there exists M G M(to,m) and (3 G B(to), 
such that, if to < ti < . . . < t n = T denotes the time grid associated to the strategy a e , it holds, 
for all k G {1, . . . , n}, that 



E 



t-k 



£(X,s,<S>(a £ (X),f3)(s))ds 



tk-i 



> E 


/ 




Jt h 



'■t k 



H{s,M s )ds 



e/n. 



(3.6) 



In parallel to the strategy f3 we shall construct a random process Z : Q x [to, T] — > J7 wich 
satisfies 

$(a £ (X),/3)(s) = (Z fl ,/3(Z)(s)) A x P-a.s.. (3.7) 

2.1) Because of the delay, on [to,ti), the control of Player I doesn't depend on the strategy of 
Player II. Since, by definition, a e is a measurable map from fiixR^ to A(to), this control depends 
also in a measurable way of (oj\,x). More precisely, we can set, for any (x, uj, v) G M. N xftx V(to)> 
ti e (x,a;) = a(x,cJi,v)\u 0itl -\ G U(to,ti) with u> = (woj^i)- We finally define the random process 
(Z s ) on the time interval [to,t±) by: Z s = u e (X) s ,s G [io>*i)- 

Then, for all /3 G <B(fo) and x € R , a trivial application of the fixed point relation (|2.ip of 
Lemma 12 . 1 1 shows that, on the same interval [to,ti), (13.7P is satisfied. 

We denote by (F s , s G [io>*l)) the completed right-continuous filtration generated by the process 
(Z s ). Let M G 7W(to,"i) be the martingale measure defined on [io>*i) by: for all B G B(M. N ), 

M S (B) = P[X G B\F 3 ], s£[t ,h). 

2.2) Suppose now that, for some k G {0, . . . , n — 1}, for all u G U(to), (3(u) is defined on [to, ifc), 
as well as (Z s ) satisfying (|3.7p on [iojifc+i)- Let M G .M(io> m ) still be a cadlag version of the 
martingale measure M° defined on [t ,t k + l) by 



/ 



f{x)M° s {dx) = E[f(X)\T s ], s G [t ,t k+1 ). 
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We suppose also that the inequality A3 .61) holds for all j € {1, . . . , k}. 
Now we extend the strategy f3 on [ifc, 

First of all, for u € U and s € [t&,t&+i), we denote by v(s,u,m) a measurable selection of 

Argmax„ g y / £(x, s,u,v)m(dx). 
Jw N 

Remark that, for all s E [to,ifc+i), M s _ is measurable with respect to 7^- = a(Z r ,r < s) VA/*, 
where A/" is the set of null-sets for the probability P. 

Therefore there exists some measurable application \t : [ioj*jfc+l) x ^(*o), such that, for all 
u € ZY(to) and all fixed s 6 [*o 5 *ifc+l)j depends only on the restriction of w on [to,s) : 

^(s,u) = \I/(s, (u r ,r € [io,s)) and such that v(s, Z s , M s _) = ty(s,(Z r ,r G [io,s])) A x P-a.s.. 
Now we set, for any (it(s), s S [io, 6 M(to) and s £ ife+i), /3 (u)(s) = (u r , r £ [to, s])). 
By Lemma 12.61 there exists, for all u € U(to) some delay 5(u) > such that 



E 



tk+l 



tk + l 



l(X,s,u s ,p"(u) s )ds-E / £(X,s,u s ,^(u) (s _ s(u))+ )d S 



< e/n. 



We can extend now the strategy /3 on [tk,tk+i) by setting 

ViiGW(i ),VsG [tfc,tfc+i)> ^(m)s = /3°(u)( s -8{u)) + - 

We get then 



E 



£(X,s,$>(a € (X),/3)(s))ds 



tk 



E 



> E 



£(X,s,Z s ,f3 (Z)(s-5(Z)) + )ds 



tk 



tk+l 



£(X,s,Z s ,p°(Z)(s))ds 



tk 



e/n. 



Further, since the filtration (J- s ) is generated by (Z s ) and by the definition of M, it holds, for 
all s G [tjfc-i, tfe), 

E^(A, S ,Z s ,/3 (Z)(s))|J- s ] = / £(x,s,Z s ,f3°(Z)(s))dM s (x) P-a.s.. 
Integrating over [tfc, ifc+i) and taking the expectation of both sides, we get 



E 



■k+i 



£(X,s,Z s ,p (Z)(s))ds 



= E 

= E 

= E 

> E 



■k + l 



■k + 1 



■k+l 



tk 



£(x, s, Z s ,v(s, Z s , M s _))dM s (x)ds 
£(x, s, Z s ,v(s, Z s , M s ))dM s (x)ds 
£(x, s, Z s , v)M s {dx) I ds 



sup 

v£V JRN 



■k+l 



H(s,M s )ds 



tk 



It remains now to extend the process Z on [tk+i, : Using the fix point Lemma |2. 11 we 
define first the map u e : M> N x Q —> U(tf.+i, tfc+2) by 



V(x,wi) eR N x 
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and set then, for all s € [ifc+i, tk+2), 

Z s (uj) = u e (X(uJo),uJi). 

The result follows. □ 

In the remaining part of this section, we prove that the infimum in (|3,4p is attained up 
to a change of probability space. Let V be the set of Radon nonnegative measures m on 
[— 1, T + 1] x R , with total mass T + 2, with a first marginal equal to the Lebesgue measure 
on [— 1, T + 1] and such that 

/ \x\ 2 m(dt, dx) < +00 . 

J(-l,T+l)xR N 

We endow V with the weak topology. Any measure m G V can be desintegrated into m(dx, ds) = 
m s (dx) ds, where m s is a probability measure on R^ for almost every s. In the sequel we 
systematically identify measure m € V and Borel families of probability measures (m s ) se r_i ,t+11- 
We denote by V the subset of V consisting in measures m € V which have a cadlag representative 
for the di distance. The topology on T is the one induced by V . We denote by t — > rat the 
canonical process on T. For a fixed initial condition (i, fh) E [0, T] x II2 we finally denote by 
A4(i,fh) the set of Borel probability measures M on T under which, 

(i) nit = fh foi t < t, 

(ii) mt € T> for t >T, where T> is the set of single Dirac masses on M. N , 

(iii) for any continuous, bounded map tp : 1^ — > R, the process t — > J RN <p(x) dm t (x) is a 
cadlag martingale for the filtration (J~t) generated by the process (rrit). 

Note that the law of any martingale measure M € A4(to,fh) belongs to A4(i, fh). 
Theorem 3.3 For any it, in) £ [0,T] x 112, there is some M € A4(i,m) such that 

V + (f,m) = J J H(s,m s ) ds dM(m) . 

Theorem l3.3l is an easy consequence of the following compactness property of the set fh): 



Proposition 3.4 Let (i,fh) € [0, T] x LT2. Let (M n ) be a sequence in M(i,rh). Then there is a 
subsequence (M n ) and a set I of full measure in [— l,T + 1] such that (M n ) converges weakly 
(as a measure over V) to some M € A4(t,fh) and (M™ ) converges weakly (as a measure over 
A(R JV ) j to M t for any t G /. 

The proof of Proposition 13.41 is a variation on a paper by Meyer and Zheng [13J. Let us start 
with some sufficient condition for a measure on V to be supported by T. For this, we need some 
notations. For m£P and ip E C° with at most a linear growth, we denote by t — >■ mt(p) the 
real- valued measurable map t — > J RN ip{x)dmt(x). 

Let t — > ff on [— 1,T + 1] be a real valued measurable map and u < v. Following |13| . 
we define the number of crossing N uv (f) as the largest number k for which we can find times 
— 1 < t\ < t'i < ■ ■ ■ < tk < t' k < T + 1 such that each set of the form (— n 00, n)), 

(*i,ti)n/- 1 ((v,+oo)), (^,t i +i)n/- 1 ((-oo,«)) and (< / fc ,T + l)n/- 1 ((w,+oo)) has a positive 
measure. Let Lip\ be the set of 1— Lipschitz continuous maps (p on R^ such that <p(0) = 0. 
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Lemma 3.5 Let M be a probability measure on V such that, for some constant C, 



M 



up / (|a;| 2 + 1) dm t (x) > R 
l,T+ll JR N 



sup 

te[-i,r+i] 



< % Vi? > 1 
R 



(3i 



and 



\u\ + C 

N uv (m(<p)) dM(m) < 1 1 Vu < v, <p € Lipi . 

p u — u 



Then M(r) = 1. 

Proof of the Lemma: We endow Lzpi with the distance 



l.x-1 2 + 1 



■oanan 



Then Lip\ is a compact set. Fix e > 0, R € (0, l/(2e)), u < v such that v — u > 2Re and 
(/j 1 , . . . , 99 ra in Lzpi such that Ufc=i B{ip k , e) D Lzpi, where B(<p k , e) is the closed ball centered at 
ip k and of radius e in Lipi. In view of our assumption, 



M 



Ar( u +- Re )("- ifc )( m (^ fc )) > - 



So 



M 



< 



sup iV~( u + e ^- e )(m(/)) > - 

ke{l,...,n} e 



\u\ + Re + C e 
v — u — 2Re n 



\u\ + Re + C 

< e 

v — u — 2Re 



In view of assumption (|3.8[) . we have 



M 



sup / (|x| 2 + 1) dm t (x) > R 
te[-l,T+i] Jr n 



< 



C 
R 



Let En denote the set of m € V such that sup / (|x| 2 + 1) dm t (x) < R. Let ip G Lip\ 

te[-i,T+i] ii" 

and m £ Er. By definition of the (<p k ), there is some /c € {!,-•■ , such that d(ip,(p k ) < e. 



Then 



Hence 



so that 



sup \mt{^) — mt((f k )\ < sup (|x| 2 + l)dm t (x) d(ip,ip k ) < Re . 
te[-i,T+l] ' ' te[-i,T+i] 

sup N uv (m(tp)) < sup AT( u+ifc )( , '- R£ )(m(/)) , 

<p£Lipi fee{l,...,n} 



M 



sup iV™(mM)>- 

ipGLipi £ I 



u + -Re + 1 C 

< — e H 

~ v-u-2Re R 



Letting e — > and then i? — > +oo we obtain, for any u < v and M — a.s. 

sup N uv (m(ip)) < +oo and sup / (|x| 2 + 1) dm t (x) < +oo 

<p&Li Pl ' ' te[-l,T+l] Jr n 



(3.9) 



It remains to show that any m satisfying the above inequalities coincides (up to a subset of 
measure 0) with an element of T. 
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Let us fix t G (0,T] and let Lt(m) the left essential upper limit of (m s ) as s —■ t : 

v G L t (m) ^ V<5 > 0, | {a G (t - S,t), m s G B(v,S)}\ > 

where B(u,5) is the ball centered at v and of radius 5 for the Monge-Kantorovich di distance. 
We claim that Lt(m) is a singleton. Indeed, note first that Lt{m) is not empty by compactness. 
Assume that Lt(m) is not a singleton. Then there would exist some v\ ^ v 2 in Lt(m). Since 

sup / (pd(vi - v 2 ) = di(Vi, u%) , 

there is some (p G Lip\ such that J RN (pd{v\ — v%) = r) > 0. Let us set u = f RN ipdv2 + 
and i> = f™ N (pdvi — rj/4. Then v > u and, by definition of L t (m), N uv (m{ip)) = +oo. This 
contradicts (|3.9|) . Therefore Lt(m) is a singleton for any i. In the same way, one can prove 
that the right essential upper limit Rt{m) of (m s ) as s — > £ + is reduced to a singleton for any 
£ G [0,T). One then easily checks that t Rt(m) is right-continuous, has a left-limit on (0, T) 
and that mt = Rt{"m) for a.e. t. Therefore m belongs to V because m has a cadlag representative 
R.(m). □ 



Proof of Proposition 13. 41 Let (M n ) be a sequence in Ai. Since, for any k > and for any 
fixed n, the random process t — > J k jv(|x| 2 A k)dm t (x) is a martingale under M n , we have, from 
Doob's maximal inequality, 



M n sup / (\x\ 2 A k)dm t (x) > R 
te[-i,T+i] 

Letting k — > +oo, we obtain 
AT 



< — / \x\ dm[x) =: — 



Vi? > 1 



sup 

te[-i,T+i] 



xl dmt(x) > 



< 



Vi? > 1 . 



Since the set |m£P, sup / |x| 2 dmt(x) < R > is compact, the sequence M n is tight and 
[ te[-i,T+i] Vr^ J 

therefore a subsequence of (M ra ), still denoted (M n ), converges weakly on T 7 to some probability 

law M. Note that 



M 



sup 

te[-i,T+i] 



Ixl 2 dmt(x) > R 



Let us now show that M is supported by T. Fix this, let us denote by E n and E the expectations 
with respect to M n and M respectively. Fix ip G Lip\ n C?(R ), where C?(R ) denotes the set 
of continuous, bounded function in TSL N . Our aim is to estimate ¥j[N uv (m(ip))]. Since, under 
M n , the process t — > J RN <p(x) dmt(x) is a martingale, its conditional variation (in the sense of 
[13] ) can be estimated by 



sup E 

te[-i,T+i] 



f(x) dm t (x 

So, by Lemma 3 of [13] . we have, for any u < v, 



< sup E n 

te[-i,r+i] 



E n [N uv (m(<p))} < 



(\x\ 2 + 1) dmt(x) 



Id +(7 + 1 



v — u 



+ 1 



< (7+1 
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Since N uv is lower semicontinuous for the weak topology, we get 

\u\ + C+l 



E[N uv (m(cp))} < 



v — u 



Now we can relax the boundedness assumption on ip to get that the above inequality holds for 
any ip G Lip\. Then Lemma 13.51 implies that M(T) = 1. Note also that, under M, m - = rh 
and m t G V for any t >T because V is closed under the weak topology. 



We now prove the finite dimensional convergence. Since V is a Polish space and M n converges 
weakly to M, Skorokhod's theorem implies that there is a probability space (Q, A, P) and random 
variables M n and M on V with respective law M n and M and such that M n almost surely 
converges to M. Note that the processes t — > M™ and t — > Mf are cadlag P— a.s. because 
M n is supported by T. Let now (p k ) be a sequence which is dense in CP(M ) (for the uniform 
convergence on compact subsets of Mr). From our assumption, the process t -»• M?tp k is a 
martingale. So, by a diagonal argument, (the proof of) Theorem 5 of [X3j gives the existence 
of a set of full measure I in [0, T] and a subsequence (again denoted (M n )) such that (M™^) 
converges to M^ fc as n — > +oo P— a.s. Since (ip k ) is dense, this easily implies that (MJ 1 ) weakly 
converges to for any t € I P— a.s.. This means that M™ converges weakly to Mt (as measures 
on A(R N )) for any t G I: for any <p G C^(A(R Ar )), 



p(v)dM?{v) 



B[cp(M?)]^B[p(M t )]= [ 

J A 



<p(v)dM t (v) 



Vt € J . 



Let us finally show that M belongs to A4. For this it only remains to show that, for any 
continuous bounded map ip : M. N — y the process Mtp is a martingale for the filtration 
generated by Mj. Let k\, . . . , k m be indices, t\ < ■ ■ ■ < t m , t be times in / and fi, . . . , f m , f be 
bounded continuous maps. Then, for any t G [0, T], and since M"</? is a martingale, 



E 



/ 1 (M£p*).../ m (M^ 1 )/(M?^ 



E 



h(Mlp k i) . . . f m (M? m v kl )f(M? Atm <p) 



Letting n — > +oo and using the finite dimensional convergence, we get 



E 



h(M tl <p k ^) . . . / m (M tm /i)/(M^)l = E [/i(M tl ^) . . . f m (M tm p k ^f(M tAtm p) 



Since M is cadlag, the a— algebra generated by the family of random variables f\ (M^ ip kl ) , 
. . . , f m (Mt m p kl ) (where k±, . . . , k m , t\ < ■ ■ ■ < t m and fi, ■ ■ ■ , f m are as above) is equal to 
(er(M s , s < t))tg[o,r]- Therefore M</9 is a martingale and the proof of the Proposition is complete. 

□ 



Proof of Theorem [3J2 

M n G M(t,fh) such that 



In view of Theorem 13.21 we know that there exists a sequence 



lim E 



H{s,M n s )ds 



V+(i,m) . 



Let M n be the law of M n and recall that M n G M(t, fh) and that 



E 



H(s,M™)ds 



J J H(s,m s ) ds dM n {m) . 
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According to Proposition 13.41 there is a measure M G M(Jt,fh), a subsequence of the (M n ), still 
denoted (M n ), and a set / of full measure in [0, +00) such that M" converges weakly (as a 
measure over A(M iV )) to Mt for any t G J. Then, for any t & I, 



n—t+oo 



lim ^ H(t,m t ) dM n (m) = J H(t,m t ) dM{m) 



because the map \i — > H(t, fx) is continuous in II2 for the di distance. Then, since H is bounded, 
we conclude by Lebesgue convergence Theorem that 



V+(t,m) 



H(t,mt) dM(m) . 



□ 



A simple application of the above characterization of the value function is the following dynamic 
programming principle: 



Corollary 3.6 We have 



V+(t,m) 



inf E 

MeM(t,m) 



[t+h 

J H(s,M s )ds + V+(t + h,M t+h ) 



Vh£[0,T-t]. (3.10) 



Moreover there exists an enlargement of (f2, J 7 , P), and, on it, some M as above such that 

-t+h 



\ + (t,m) = E 



H{s, M s )ds + V + (i + h, Mi 



t+h j 



V7t G [0, T - 1] , 



Proof: As usual, we split the relation (|3. lOj) in two inequalities which we prove separately. 
Let us denote by V h (t,m) the right hand side of (|3.10p and, for e > 0, let M 6 G Mf(t,m) be 
an e-optimal martingale measure for \ h (t,m) with finite support (i.e., the support of M e is 
concentrated on a finite number of measures). 

Let Ai, . . . ,A n be the atoms af the cr-algebra and mi, . . . , m n G 1I2 the values taken by 

M^ +h on these sets. Remark that, for all i G {1, . . . , n}, nii is the law of the restriction of X on 
At. 

For each i G {1, . . . , n}, let MW g A4(t + /i, mi) be e-optimal for V(t + h, mi) and define some 

measure valued processes (M*,s G + T]) such that M l |^. x r t+ ^ r i = and with terminal 
value Mt = Sx- 
Finally we set 

Ml for s < t + h, 

Ml on Ai X [t + h,T\, i G {1, . . . , n}. 



Mt 



It is easy to prove that M e G A4(t,m). Therefore it holds that 
V+(t + h,M t+h )= E7=i^A i y + (t + h,m i ] 



tf +h H(s,M^)ds 

T 



E 



SL h H{s,Ml)ds\T*ll 
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It follows that 



V h (t,m)> E 
= E 



Jl +h H(s, Mt)da + E H(s, Mf)ds 
2e 



2e 



ffH(a,Mf)da 



> V+(t,m)-2e. 

Since the last relation holds true for all e > 0, we get our first inequality: 

V h (t,m) > V + (i,m). 

1.2 Consider now M e E Mf(t, m) being e-optimal for V + (t, m). Again we denote by Ax, . . . , A ri 
the atoms of and by mi, . . . , m n the values taken by M£ +h . 
Then we can write 



V + (t,m) > E 



r-t+h n r i-T 

/ H(s,M e s )ds + y2l Ai E / H(s,M e s )ds\Ai 

Jt i=1 Ut+h 



e. 



Now, restricted on Ai, M e is a martingale measure with initial condition m«. Therefore it holds 
that 



E 



H(s,M e s )ds\Ai 



t+h 



> V + (t + h,mi). 



The dynamic programming principle follows. 



2. By Theorem 13.31 we can enlarge the probability space (ft, J 7 , P) such that there exists 
M £ M(t,m) which is optimal for \~ + (t,m). For e > 0, let M e 6 Mf(t,m) such that 
E[J^_ h di(Mg, M s )ds] < e. Since the trajectories of M are cadlag, we can choose M € such 
that E[di(Mj: +h , M t+ h)] < e. Using the fact that V is Lipschitz in m, we get now 

E[V+(t + h,M t +h)] < E[V+(t + h,MZ +h )\ + Ce 

= E^iV+it + h^m^iA^ + Ce, 

where A\, . . . ,A n are the atoms of T^ h and mi, . . . , m n the values taken by M£ +h on them. 
Now, since, for each i € {1, . . . , n}, the restriction of (M s e )t+ft< s <T on belongs to .M(t+/i, m^), 
and then, using the fact that H is Lipschitz, we have 

E[J2^ + (t + h, mi )l Ai ] < E[j^ h H(s,M!)ds] 



< E[J t \ h H(s,M s )ds] + Ce. 



It follows that 



E[V + (t + h,M t+h )]<E[ H(s,M s )ds}. 

I t+h 



(3.11) 



Finally, using the first part of the Lemma, we get 



E 



Sl +h H(s, M s )ds + V+(t + h, M t+h ) 



< E 



J t m M s )ds + f t 2 +h H(s, M s )ds 



V(t,m) 



m ^M&M{t,m) E 



f t t+h H(s, M s )ds + V+(t + fc, Af t+A ) 



< J5 



J, m (a, M s )ds + V+(t + fc, M m ) 



The result follows. 



□ 
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4 Characterization of the value function. 



In this section, we give two different characterizations of the value function V + as a viscosity 
solution of some deterministic functional equations. The first one, stating that V + is the largest 
subsolution of some equation, is interesting by its simplicity. The second one is purely local, but 
is more involved in its formulation and derivation. 



4.1 Characterization of the upper value function as largest subsolution of 
some HJI-equation. 

Proposition 4.1 The value function V + is the largest continuous map on [0, T] x II2 which 
satisfies 

i) For all m G U 2 , V + (T, m) = 0, 

ii) V + is convex with respect to m, 

Hi) for all m G 112, V + (-,m) is a subsolution (in the viscosity sense) of the following ordinary 
differential equation 

^V + (t,m)+H(t,m) = in(0,T). (4.12) 

Proof: The map V + clearly satisfies V + (T, m) = for all m G II2. Moreover V + is convex in m 
by Lemma 12.41 Let us now check that, for any m G LI2, V + (-,m) is a subsolution of (|4.12p . For 
t G [0,T), let 4> G C l ([Q,T}) be such that V+(-,m) < <j) and V+(t,m) = 4>(t). Let M G M(t,m) 
be the martingale measure defined by 



M r 



m if r G [t, T), 

5 X with probability m for t >T. 



By dynamic programming (Corollary 13. 6p . we have, for any h G [0, T — t], 

*t+h 



/t+n 
H(r,M r )dr + V + (t + h,M t+h ) 



0(f) =V+(t,m) < E 

< h H(r,m) + <p(t + h) . 
The result follows by dividing by h and letting h — > 0. 

We now prove that V + is the largest subsolution. Let w : [0, T] x LI2 — > M be convex with 
respect to m, with w(T, •) = and such that w(-, m) is a subsolution of (|4.12p . We have to prove 
that w < V + . For (to, mo) G [0, T] x LI2, let to < t\ < . . . < t n = T be a subdivision of [t, T], 
with tk + i — tk = t > 0. 

For m G LT 2 , k G {1, . . . ,n - 2} and e > 0, let w £ (t) = sup{w(s, m) - ^\t - s\ 2 ,s G [0,T]} be 
the sup-convolution of w on the interval [tk,tk+i]- Then (see e.g. [2]) the map w e is a locally 
Lipschitz subsolution on [tk,tk+i] of 

(w e )'(t) + H(t,m) > -o(l). 

It follows that 



u; e (t fc+ i) - w^tk) + / " +1 H(s, m)ds > -ro(l) 
Jt k 

Since w e \ w(-,m) as e \ 0, we get for w(-,m): 



w{tk+i,m) — w(tk,m) + I H(s,m)ds>0. (4-13) 
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Let now M £ M(t ,m ) and let us define M T £ M(t ,m ) by 

M T s =M tk forsG [t k ,t k+1 ) 

From (|4.13p . we get 



E 



w(t k+1 ,M tk+1 )-w(t k ,M tk+1 )+ / H(s,M tk+1 )ds 



-fc+i 



> 0. 



where, since w is convex and M a martingale measure, 

E[w(t k ,M tk+1 )\T tk ] >w(t k ,M tk ). 

It follows that 



E 



w(t k+l ,M tk+1 )-w(t k ,M tk )+ / H(s,M tk+1 )ds 



•fc+i 



> 0. 



(4.14) 



Summing up the right-hand side of (|4.14p over all k € {0, ... , n— 1} and recalling that w(T, •) = 0, 
we get 



w(t Q ,m ) < E 



E / H(s,M tk+1 )ds 



.k=0 lk 



Since (M s ) is cadlag, letting r — >• yields to 



H(s,M s )ds 



w{t ,m ) < E 

Now we take the infimum over M to get the desired result: 

w(t ,m ) < V + (t ,m ) 



□ 



4.2 Characterization of the value of the game as dual solution of a HJI- 
equation. 

The main drawback of the previous characterization is that it is of nonlocal nature. We now 
show that it is possible to characterize the value function by local inequalities. We use here 
several ideas of [6]. 

Definition 4.2 Let V : [0, T]xU 2 ^ E. 

1. Dual supersolution: We say that V is a viscosity dual supersolution to 



dV 

— (t,m) + H(t,m) = 



(4.15) 



ifV is lower semicontinuous, V(t, •) is convex for any t and if, for any fh G II2 and smooth 
test function ip : [0, T] — )■ K such that t —> V(t, fh) — (p(t) has a local minimum ati € [0, T) 
with fh extreme point of the graph ofV(i, ■), one has 



<p'(t) + H(t,m) < 



19 



2. Dual subsolution: We say that V is a viscosity dual subsolution to $i4-15\ ) if V is upper 
semicontinuous, V(t, •) is convex for any t and if, for any fh E II2 and smooth test function 
ip : [0, T] — » R suc/i t/ia< t — > V(t,fh) — (p(t) has a local minimum at i E [0,T) ; one has 



ip'(t) + H(t,fh) > 

5. Dual solution: We say that a continuous map V : [0, T] x II2 
solution of Ii4-15\ ) if it is a sub and a supersolution of \4- 15\ ). 

Proposition 4.3 The value function V + is a dual solution to 

^{t,m) + H{t,m)=0 
V(T, m) = Vm E n 2 



is a viscosity dual 



(4.16) 



Proof : By Proposition 14.11 we know already that V + is a subsolution of (|4.16p . Let now any 
fh E H2 and <p : [0, T] — > R be smooth test function such that V + (t, to) > <p(t) with an equality 
at t and m is an extreme point of the graph of V + (t, •). Let M be the optimal martingale 
measure as in Corollary 13.61 



V + (t,m) = E 



t+h 



H(s, M s )ds + V+(t + /i, Mj 



v/i e [0, r - 1] . 



(4.17) 



Taking /i = in (I4.17|) gives 



V+(t,m) = E V + (t,M t 



so that Mj+ = m because m is an extreme point of V + (t, •). Since V + is convex in to, we have 

E[V+(t + h,Mt +h )] > V + (t + h,fh). 
Replacing this in the right hand side term of (I4.17p . we obtain 



tp(j) = V + (t,fh) > E 



t+h 



H(s,M s )ds 



+ \ + (t + h,m) > E 



t+h 



H(s,M s )ds 



Dividing by h and letting h — » + in the above inequality gives the desired result. 



+ (p(t + h). 

(4.18) 
□ 



Proposition 4.4 (Comparison) If Vi is a dual supersolution and V2 is a dual subsolution, 
with V X (T-) < V 2 (T, •) in U 2 , then V 1 < V 2 in [0,7] x n 2 . 



Remark 4.5 In particular V is the unique dual viscosity solution of equation ^4-16 ) 



Proof : Let us fixi|,M> 0. We argue by contradiction, assuming that, for e > sufficiently 
small, 

( s - t ) 2 

sup Vi(s, to) - V 2 (t, to) - ' T]t > 0, 

t,s,m ^£ 

where the supremum is taken over the Borel probability measures m with a support in B(0, M). 
Since this set is compact, there is a maximum point (s £ ,^,TOq). As V±(T-) < V 2 (T, •), we 
have s e ,t e < T when e is small enough. Let C t be the set of maximum points of the form 
(s t ,i t ,m) and let rrf be an extreme point of C t . By Caratheodory Theorem, rrf belongs to C e . 
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We claim that m e is an extreme point of the graph of V 2 (t 6 ,-). Indeed, if m e = mi + m2 with 
V 2 {i £ , mi) = V 2 (i e , m 2 ) = V 2 (i e , rh e ), we have 

i=l 

by convexity of Vi(s e ,-). Now note also that the support of mi and the support of m 2 are 
in B(0, M) because so is the support of frf . By optimality of frf the points (?,t £ ,mi) and 
(s e ,i € ,m 2 ) belong to C e and therefore mi = m 2 = m e since m e is an extreme point. 

We now use the definition of viscosity dual solutions: since the map s — >• Vi(s,m e ) — ^ 
has a maximum at s e , we get 

S ^^- + H{s e ,m e ) >0. 

Since the map t — > V 2 (t,m e ) + — 2 ^ rjt has a minimum at s e with m t an extreme point of 

the graph of V 2 (s e , ■), we get 

s e — i € 

r) + — - — + H(s e , m e ) < 

So 

rj + H(s e ,m e ) - H(s e , m e ) < . 

As e — > 0, we have s e ,i e — > i and m e — > m (up to some subsequence), so that r/ < 0. This 
contradicts the definition of r\. 

In conclusion, for any e > and T] > and for any (s, m) G [0, T] x II2 such that the support 
of m is in B(0, M), we have 

Vi(s,m)-V 2 {t,m)- (S ~^ -7/t < 0, 

Taking s = t, and letting 77 — > + and M — > +00, we obtain that inequality V\ (t, m) — V 2 (t, m) < 
holds for any (t, m) such that m has a compact support. We complete the proof by density. 
□ 
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